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Abstract 

We report on a search for the lepton flavor violating t~ — > /i~7 and t~ — > e~7 
decays based on 535 fb _1 of data accumulated at the Belle experiment. No signal is 
found and we set 90% confidence level upper limits on the branching ratios B(t~ — > 
/i~7) < 4.5 x 10" 8 and S(t~ e~j) < 1.2 x 1(T 7 . 
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1 Introduction 



Lepton flavor violation (LFV) could appear in various new physics scenar- 
ios beyond the Standard Model, e.g., in the Minimal Supersymmetric exten- 
sion (MSSM) [1], in Grand Unified Theories [2], and see-saw mechanisms [3]. 
In most models describing LFV in the r lepton sector, the radiative decays 
t — > /x(e)7 have the largest probability; this has motivated many experimental 
searches [4-10]. Using 86 fb _1 of data recorded at the T(4S*) resonance with 
the Belle experiment [11] at the KEKB asymmetric-energy e + e~ collider [12] 
we have previously obtained the upper limits £>(r~ — > fi~j) < 3.1 x 10~ 7 [13] 
and B(t~ -> e~i) < 3.9 x 1(T 7 [14] at the 90% confidence level (CL). The 
BaBar collaboration subsequently obtained the upper limits B(t~ — > /i~7) < 
6.8 x 10" 8 [15] and B{r~ -> e~i) < 1.1 x 10~ 7 [16] with 232.2 fb" 1 of data. 
Here, we report on an updated analysis with 535 fb" 1 of data, which corre- 
sponds to 4.77 x 10 8 produced t + t - pairs [17]. 

The Belle detector is a large-solid-angle magnetic spectrometer that consists 
of a silicon vertex detector (SVD), a 50-layer central drift chamber (CDC), an 
array of aerogel threshold Cherenkov counters (ACC), a barrel- like arrange- 
ment of time-of-flight scintillation counters (TOF), and an electromagnetic 
calorimeter comprised of CsI(Tl) crystals (ECL) located inside a supercon- 
ducting solenoid coil that provides a 1.5 T magnetic field. An iron flux- return 
located outside the coil is instrumented to detect mesons and to identify 
muons (KLM). The detector is described in detail elsewhere [11]. 

The basic analysis procedure is similar to our previous one [13,14]. The selec- 
tion criteria for r~ — > //~7/e~7 are determined and optimized by examining 
Monte Carlo (MC) simulated signal and background (BG) events, including 
generic r + r~, qq (q = u, d, s, c, b), Bhabha, and two-photon events. The 

BG t + t~ events are generated by the KKMC/TAUOLA [17] and the response 
of the Belle detector is simulated by the GEANT3 [18] based program. 

Photon candidates are selected from ECL clusters that are consistent with an 
electromagnetic shower shape and not associated with charged tracks. Muon 
candidates are identified by using a muon likelihood ratio, £ M [19], which is 
based on the difference between the range of the track calculated from the 
particle momentum and that measured by the KLM. This ratio includes the 
value of x 2 formed from the KLM hit locations with respect to the extrapolated 
track. The muon identification efficiency for these selection criteria (£ M > 0.95) 
is 90%, with a pion fake probability of 0.8%. Identification of electrons uses 
an electron likelihood ratio, C e , based on dE/dx information from the CDC, 
the ratio of the energy deposited in the ECL to the momentum measured by 
the CDC and SVD, the shower shape in the ECL, hit information from the 
ACC and matching between the positions of the charged track and the ECL 
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cluster [20]. The electron identification efficiency for these selection criteria 
(C e > 0.9) is 95%, with a pion fake probability of 0.07%. 



2 r — ► /L*7 

2.1 Event Selection 

We select events that include exactly two oppositely charged tracks and at 
least one photon, consistent with r + r~ decays: one t^ 1 (signal side) decays 
to /i ± 7 and the other (tag side) decays to a charged particle that is not a 
muon (denoted hereafter as /ft), neutrino(s) and any number of photons. In 
this analysis, before particle identification, we assign the pion mass to all 
charged tracks to calculate their energies and momenta in the center-of-mass 
(CM) frame. 

Each track must have a momentum p CM < 4.5 GeV/c in the CM frame to 
reduce contamination from Bhabha and p + p~ events and a transverse com- 
ponent to the beam axis of pt > 0.1 GeV/c within the detector fiducial region, 
—0.866 < cos 9 < 0.956, to suppress two-photon background. Here 6 is the 
polar angle with respect to the z axis, which is anti-parallel to the e + beam. 
(Hereafter, all the variables defined in the CM frame have superscripts "CM" .) 
Each photon is required to have an energy E 1 > 0.1 GeV within the fiducial 
region. The total energy in the CM frame must be E^^ < 10.5 GeV to fur- 
ther suppress Bhabha and p + p~ events. The magnitude of the thrust vector, 
constructed from all selected charged tracks and photons mentioned above, is 
required to be in the range from 0.90 to 0.98 in order to suppress p + p~ and 
qq background (Fig. 1(a)). 

For muon identification, we require a likelihood ratio of £ M > 0.95 and p > 
1.0 GeV/c. On the tag side, a track with £ M < 0.8 is defined as i/l. The 
photon that forms a (/ry) candidate is required to have E 1 > 0.5 GeV and 
—0.602 < cos6* 7 < 0.829 to remove any spurious combinations of 7's. 

The opening angle between the p and 7 of the (/ry) candidate, 0.4 < cos 9™ < 
0.8, is useful in rejecting t + t~ background that contains 7r°'s from r decays 
(Fig. 1(b)). The sum of the energies of the two charged tracks and the photon 
of the (/ry) candidate, E^^, should be less than 9.0 GeV to reject p + p~ events. 
The opening angle between the two tracks should be greater than 90° in the 
CM frame, and the opening angle between the p and the boost direction of 
its mother r from the CM frame is required to satisfy cos 6^ < 0.4 in the r 
rest frame, to remove combinations of /i's and 7's from BG (Fig. 1(c)). 



5 




0.8 0.82 0.84 0.86 0.88 0.9 0.92 0.94 0.96 0.98 

length of thrust vector 





700 




600 


IT) 




O 




O 


500 












400 


o 




<^ 











}(«) 




200 




100 








(c) 



-1 -0.8 -0.6 -0.4 -0.2 0.2 0.4 0.6 0.8 1 

cos e^ T 




-0.2 



(b) 








SI 






i 



0.4 0.6 

cose^ 



(d) 



> 

O 



MP* 



m v 2 (GeV7c ) 



Fig. 1. (a) Magnitude of the thrust vector, (b) cos 9^, (c) cos 9^ and (d) m 2 
distributions for r — > fij. Dots are data, open boxes show the BG MC distribution 
and shaded histograms are the signal MC. Arrows indicate the selected region. 
Here, the branching ratio of r — > ^7 is assumed to be 1.0 x 10~ 5 for the signal MC 
histograms. The requirements on particle identification for the signal and tag sides 
and 1.5 GeV/c 2 < M- mv < 2.0 GeV/c 2 , -0.5 GeV < AE < 0.5 GeV are imposed 
here. 



The following constraints on the momentum and the polar angle of the missing 
particle are imposed: p m i SS > 0.4 GeV/c and —0.866 < cos# m i SS < 0.956. Here, 
p m i SS is calculated by subtracting the sum of the momenta of all charged tracks 
and photons from the beam momenta. To remove the r + r~ background events, 
a requirement on the opening angle between the tag-side track and the missing 
particle is applied, 0.4 < cosdz^ d < 0.98. We calculate the missing mass 



squared on the tag side, m 2 



~ (SJ 2 , where E™ (E™) is 



iCM 
miss- 

/pCM _ pCM\2 _ 

\ ji'y tag / \fmiss) ' VV±1CJ - C ^fjrf V^tag 

the sum of the energy of the signal side /i and 7 in the CM frame, and then 
require —1.0 GeV 2 /c 4 < m 2 < 2.0 GeV 2 /c 4 , as shown in Fig. 1(d). Finally, the 
condition, » miw > — 5 x mt,- — 1 and > 1.5 x m 2 ,- „ — 1, 



missing mass is given by m 



2 

miss 



and p n 
El^ - 



■r miss 



m GeV/c 2 



is imposed. The 
where E miw is the 



sum of the beam energies minus the visible energy. This relation is illustrated 
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by Fig. 2. 




mUGeVV) 

Fig. 2. Distributions in m miss - p m i ss plane for data (dot) and signal MC (shaded 
box) events. Events are chosen between the two lines in the figure. Also, p m i ss > 0.4 
is required. The two lines correspond to the equations p m i ss = — 5 x m miss — 1 and 
Pmiss = 1-5 x w. miss — 1. The applied requirements are the same as those in Fig. 1. 



2.2 Background contribution 



After the selection requirements described in the previous subsection, the dom- 
inant BG source is r + r~ events with the decay t^ 1 — > jj^u^Uj. or r^ 1 —> -k^v t 
where the ir is misidentified as a \i and is then combined with a photon from ini- 
tial state radiation or beam BG. Another source is the radiative e + e~ — > fi + fi~ 
process. 

Two variables are used to identify the signal: M mv , the invariant mass of (/^y), 
and AE = E™—E™ m , the energy difference between the (7x7) energy and the 
beam energy in the CM frame, where the signal should have M- mv ~ m T and 
AE ~ 0. The resolutions in M inv and AE are estimated by fitting asymmetric 
Gaussians to the signal MC distributions giving a^f 1 / 1 ™ = 14.49±0.10/24.24± 

0.13 MeV/c 2 and a^f 1 ^ = 35.29 ± 0.49/81.41 ± 0.94 MeV, where - high / low 
means the standard deviation on the higher/lower side of the peak. 

To compare the data and MC simulation, we examine a 5a region with 1.65 
GeV/c 2 < M inv < 1.85 GeV/c 2 and -0.41 GeV < AE < 0.17 GeV, as shown 
in Fig. 3(a). A 'blind analysis' method is used: a 3a region as indicated by the 
dashed ellipse in Fig. 3(a) is 'blinded' (not examined) until all selection criteria 
are finalized. The detection efficiency for this region is determined from MC 
simulation to be 6.05%. 

After the selections, we find 71 events remaining in data and 73.4±6.7 events 
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in MC in the 5a region outside the blinded ellipse. According to MC, the 
remaining events are dominated by the initial state radiation process t + t~j 
-58.8 ±4.3 (70.3 ±4.7) events and also include 13.1 ±4.9 (15.0 ±5.3) /i + /i~7 
events with incorrect /i identification, and 1.6 ± 1.6 (3.2 ± 2.2) two-photon 
events, where the numbers in parentheses are the BGs that remain in the 
entire 5a region. 

This background composition was understood in the previous analysis; the 
r + r _ 7 process yields contributions in the AE < region, while /i + yU~7 events 
mostly have AE > 0. This BG distribution is well represented by a combi- 
nation of Landau and Gaussian functions, as found in Ref. [14]. To obtain 
the final BG distribution, we perform a binned maximum likelihood fit to the 
candidates in the 5a region outside the blinded ellipse. The final event distribu- 
tion in the data is very similar to that obtained from the MC: (79.0 ± 9.2)% is 
t + t~7, (15.8±8.5)% is /i + /x~7, and (5.2±4.1)% is from e + e~7 — > e + e~fi + fi~. 

2.3 Signal extraction 

After unblinding, we find 23 and 94 data events in the blinded and 5a regions, 
respectively, while 15.0 ±3.1 and 88.4 ±7.4 events are expected from the MC. 
Figure 3(a) shows the final event distributions (data and signal MC) in the 
M- mv -AE plane. 

In order to extract the number of signal events, we employ an unbinned ex- 
tended maximum likelihood (UEML) fit with the following likelihood function: 

-( s +6) N 

C = II {*Si + bBi) . (1) 

JV - i=l 

Here, N is the number of observed events; s and b are the numbers of signal 
and BG events to be extracted, respectively; Si and Bi are the signal and BG 
probability density functions (PDF), where % indicates the 2-th event; the shape 
of the signal PDF, Si, is obtained by smoothing the signal MC distribution, 
and Bi is the PDF for the background mentioned above, whose distribution 
is concentrated around AE ~ —0.2 GeV, as indicated by the solid line in 
Fig. 3(a). To enhance the signal detection sensitivity and to avoid this dense 
BG region, we use a 2a ellipse as the signal region for the UEML fit. The 
result of the fit is s = — 3.9±1;|, b = 13.9i^ with N = 10. 

Figure 3(b) shows the event distribution within the 2a band of the shorter 
ellipse axis, projected onto the longer ellipse axis, and the best fit curve. No 
events are found near the peak of the signal distribution. The negative s value 
is consistent with no signal. 
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Fig. 3. (a) Mi nv - AE distribution in the search for r — > fij in the 5a region. Dots 
are the data and shaded boxes indicate the signal MC. The dashed ellipse shows the 
3a blinded region and the dot-dashed ellipse is the 2a signal region. The dashed lines 
indicate the 2a band of the shorter ellipse axis, projected onto the longer ellipse axis. 
The solid line indicates the dense BG region, (b) Data distribution within the 2a 



(0)> 



and a = 46° . We obtain 



band. Here, £ = AE- AE^ ,M = 3.0xc 2 x (M inv - M- 

the most probable values AE^ and Af£J, Af£J = 1-776 GeV/c 2 , AE<® = -5 MeV, 
by fitting the signal MC distribution to an asymmetric Gaussian. Points with error 
bars are the data and the shaded histogram is the signal MC assuming a branching 
ratio of 5 x 10 -7 . The solid curve shows the best fit. 

We examine the probability to obtain this result and evaluate the 90% CL 
upper limit using a toy MC simulation. The toy MC generates signal and BG 
events according to their PDFs fixing the expected number of BG events (b) 
at b = b, while varying the number of signal events (s). For every assumed s, 
10,000 samples are generated following Poisson statistics with means s and b 
for the signal and BG, respectively; the signal yield (s M ) is evaluated by the 
UEML fit. To obtain the upper limit at the 90% CL (§90) we take an s value 
that gives a 10% probability for s MC to be smaller than s. The probability 
to obtain s < —3.9 is 25% in the case of a null true signal. In other words, 
due to BG fluctuations a negative s value is possible with a large probability, 
although the physical signal rate is positive [21]. 

The toy MC provides an upper limit on the signal at the 90% CL as s 90 = 2.0 
events from the UEML fit. We then obtain the upper limit on the branching 
ratio £>9o(t — > fi^y) at the 90% CL as 



B 90 (t -> fi y) 



s 90 

2eN T . 



4.1 x 10" 



where the number of r pairs produced is N TT = (4.77 ± 0.07) x 10 8 , and the 
detection efficiency for the 2a ellipse region is e = 5.07%. 

The systematic uncertainties for the BG PDF shape increase Sgo to 2.2 [22]. 
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The other systematic uncertainties arise from the track reconstruction effi- 
ciency (2.0%), the photon reconstruction efficiency (2.0%), the selection cri- 
teria (2.2%), the luminosity (1.4%), the trigger efficiency (0.9%), and the MC 
statistics (0.3%). All contributions are added in quadrature to obtain the total 
uncertainty of 4.0%. This uncertainty increases the upper limit on the branch- 
ing ratio by 0.2% [22]. Since the angular distribution for r — * /ry depends on 
the LFV interaction structure, we evaluate its effect on the result by assuming 
the maximum possible variation, V ± A interactions, rather than the uniform 
distribution that is the default in the MC analysis. No appreciable effect is 
found for the upper limit. 

Finally, the following upper limit on the branching ratio is obtained: 

B(r~ -> fj,~j) < 4.5 x 10" 8 at the 90% CL. (3) 



3 r — > ej 

For r — > e7 we use a procedure similar to that for r — > /17. 
3.1 Event Selection 

We examine a r + r~ sample, in which one r decays to an electron and a 
photon, and the other r decays to a charged particle, but not an electron 
(/), neutrino(s) and any number of photons. Because the selection criteria are 
quite similar to those for r — >• /ry, below we describe only the differences. 

An obvious difference is the replacement of the /i by an e on the signal side, 
and using an e veto (f) rather than a \i veto {$) on the tag side. The electron 
on the signal side {erf) is required to have C c > 0.90 and a momentum p > 1.0 
GeV/c, while the ft on the tag side should have C c < 0.1. Minor differences in 
the kinematical selection include requirements on the missing mass squared 
on the tag side and the opening angle between the tag-side track and the 
missing particle on the tag side: —0.5 GeV 2 /c 4 < m 2 < 2.0 GeV 2 /c 4 , and 
0.4 < cosO^faj < 0.99. The other requirements are the same as those for 
t — > fi'y, as shown in Fig. 4. 

The M inv and AE resolutions are a^ low = 14.76 ±0.18/25.38 ±0.38 MeV/c 2 
and a5| h/low = 35.66±0.62/89.98±1.72 MeV. The 5a region with 1.65 GeV/c 2 
< M inv < 1.85 GeV/c 2 and -0.45 GeV < AE < 0.18 GeV is used for the signal 
evaluation. A 3a ellipse is also blinded. 



10 



After the selection requirements we find 42 and 34.7 ± 3.3 events outside the 
blind in the 5a region in data and MC, respectively. As our MC study shows, 
the BG comes from t + t~7 events. 
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Fig. 4. (a) Magnitude of the thrust vector, (b) cosflSr, ( c ) cos6 eT and (d) m 2 
distributions for r — ► ey. Dots are data, open boxes show the BG Monte Carlo(MC) 
distribution and shaded histograms are the signal MC. Arrows indicate the selected 
region. Here, the branching ratio of r — ► e^f is assumed to be 5.0 x 10 -6 for the signal 
MC histograms. The requirements on particle identification for the signal and tag 
sides and 1.5 GeV/c 2 < M inv < 2.0 GeV/c 2 , -0.5 GeV < AE < 0.5 GeV were 
applied for these figures. 



3.2 Signal extraction 



After opening the blind we find 13 and 55 data events in the blinded region 
and 5cr region, respectively, while the MC predicts 8.1 ± 1.6 and 42.8 ± 3.7 
events, respectively. Figure 5(a) shows the event distribution in the M inv -AE 
plane. 
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Fig. 5. (a) Mj nv - AE distribution in the search for r — > ej in the 5a region. Dots are 
the data and shaded boxes indicate the signal MC. The dashed ellipse shows the 3a 
blinded region and the dot-dashed ellipse is the 2a signal region. The dashed lines 
indicate the 2a band of the shorter ellipse axis, projected onto the longer ellipse axis. 
The solid line indicates the dense BG region, (b) Data distribution within the 2a 
band. Here, 8 = AE- AE^ ,M = 3.0xc 2 x (M inv - Alj®) and a = 48°. We obtain 
the most probable values AE<® and m£), Af£J = 1.775 GeV/c 2 , AE<® = -2 MeV, 
by a fit of the signal MC distribution to an asymmetric Gaussian. Points with error 
bars are the data and the shaded histogram is the signal MC assuming a branching 
ratio of 5 x 10~ 7 . The solid curve shows the best fit. 

The signal extraction process is the same as that for r — > /ry, described in the 
former section. The BG is composed of (18 ± 18)% e + e~ 7 (radiative Bhabha), 
while the remainder is t + t _ 7 . No other background source is found in MC. 
The UEML fit over the 2a ellipse region results in s = — 0.14±|;if, b = 5.14±|;|f 
with N = 5. The toy MC gives a probability of 48% to obtain s < —0.14 in the 
case of a null signal. Figure 5(b) is the same as Fig. 3(b), but for the r — > e 7 
case. The upper limit of s 90 = 3.3 is obtained by the toy MC in the case of 
the UEML fit result. The upper limit on the branching ratio is calculated as 

B 90 (t~ - e- 7 ) = = 11.7 x 1(T 8 , (4) 



where the detection efficiency for the 2a ellipse region is e = 2.99%. 

The systematic uncertainties for the BG PDF shape increase Sgo to 3.4. The 
other systematic uncertainties are similar to those for r — > /17; minor differ- 
ences are in the selection criteria (2.5%) and the trigger efficiency (2.0%). The 
total uncertainty is 4.5%, and it increases the upper limit on the branching 
ratio by 0.2%. Taking into account this systematic error, we obtain the 90% 
CL upper limit, 

B{t~ -> e~7) < 12.0 x 10~ 8 . (5) 
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4 Summary 



We have updated our searches for the LFV decay modes, r — > /17 and r — > e7, 
using 535 fb -1 of data, corresponding to about six times higher statistics than 
in the previous publication [13,14]. In this study, we have introduced four new 
requirements for E^^, ml, cos6^ r and the magnitude of the thrust vector 
in the r — > 7/7 search and three new requirements for ml, cos6* eT and the 
magnitude of the thrust vector in the r — > ej search. As a result of the 
optimized selection criteria, we obtain e = 5.07 (2.99)% and A Q b s = 10 (5) 
events in the 2a elliptical signal region for r — > ^7 (ej) in this analysis, 
compared to e = 12.0 (6.39)% and A obs = 54 (20) events over a 5cr signal 
box in our previous study. The improved selection leads to a value of e/ \/A b S 
that is almost the same as that in the previous analysis, and therefore the 
expected upper limit, which is approximately proportional to y/N ohs / (e / Ldt) 
in the case of no signal, has improved as 1/ J Ldt rather than in proportion 
to 1/ yj J Ldt, as would be the case if the previous selection criteria were used. 
(Here / Ldt is the integrated luminosity.) 

The resulting upper limits on the branching ratios are 



B{j- 



/i"7)<4.5 x 10~ 8 , 
e"7)<12.0x 10 _i 



at the 90% CL. 



(6) 
(7) 



The limit on the branching ratio of the r~ — > /i~7 decay is the most stringent 
among all LFV decays of the r lepton to date. Our results constrain the 
parameter space of various theoretical models that predict LFV decays [1-3]. 
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